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ABSTRACT 



A dynamic transfer syntax efiScienlly transfers data, includ- 
ing large data images, from_^6XXe.r to at Icast^one^liGnt. 
Source data is transformed into a hierarchical representation. 
The hierarchical representation, consisting of essentially 
non- redundant data, is a plurality of levels of transform data, 
such that a level of the hierarchical representation comprises 
transform data sufficient to reconstruct the source data at a 
resolution corresponding to the level. The server transfers 
transform data from a level of the hierarchical representation 
corresponding to a desired resolution. To render a new view 
of the source image at the client, the client requests from the 
server coefiacienis of the transform data necessary to recon- 
struct the new view. In response to the request, the server 
transfers to the client the additional transform data, and the 
client reconstructs the new view from the coefficients trans- 
ferred. A medical imaging application for the dynamic 
transfer syntax is disclosed. 

21 Claims, 19 Drawing Sheets 
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FIG. 2B 
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METHODS AND APPARATUS FOR 
DYNAMIC TRANSFER OF IMAGE DATA 

CROSS-REFERENCES TO RELATED 
APPLICATIONS 

This application claims the benefit of U.S. Provisional 
Application No. 60/091,697, filed Jul. 3, 1998, entitled 
"Flexible Representation and Interactive Image Data Deliv- 
ery Protocol." 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention is directed toward the field of data 
transfer, and more particularly toward efficient techniques 
for transferring large amounts of data over networks. 

2, Art Background 

Historically, imaging systems have relied upon photo- 
graphic film for the storage, distribution, and use of images. 
For example, medical images such as X-rays historically 
have been rendered on film sheets. The film sheets are stored 
in a repository such as a medical records library, and they are 
retrieved and distributed to doctors or other individuals for 
viewing. The images are viewed by placing the film on a 
viewing box that passes light through the film. 

However, the use of photographic film for some imaging 
applications has considerable drawbacks. The need to physi- 
cally retrieve a film from a repository imposes undue delay, 
particularly problematic when access time is important, such 
as when a medical emergency exists. Also, films tend to get 
lost or misplaced, so that costs may be increased and/or the 
quality of services rendered may be decreased. 

For these reasons and others, it has become more common 
for images to be stored, distributed, and viewed in digital 
form using computer technology. In the medical field Picture 
Archival and Communication Systems or PACS have been 
in widespread use. In a typical PACS application, image data 
obtained by imaging equipment such as CT scanners or MRI 
scanners is stored in the form of computer data files. The size 
of a data file for an image varies depending on the size and 
resolution of the image. For example, a typical image file for 
a diagnostic-quality chest X-ray is on the order of 10 
megabytes (MB). The image data files are usually formatted 
in a "standard" or widely accepted format. In the medical 
field, one widely used image format is known as DICOM. 
The DICOM image data files are distributed over computer 
networks to specialized viewing stations capable of convert- 
ing the image data to high-resolution images on a CRT 
display. 

In imaging applications, such as medical imaging, it is 
important to display images at a high resolution, so that 
image details having potential diagnostic significance are 
visible. Concurrent viewing of multiple images, captured 
over time, is also desirable in order to enable the detection 
of changes that occur over a time period. The need for high 
resolution and multiple views translates into a need for high 
network bandwidth, large storage capacity, and significant 
processing power at the viewing stations. The traditional 
digitally encoded medical images, used in medical 
applications, usually require powerful and expensive com- 
puter systems to archive, distribute, manipulate, and display 
the medical images. Consequently, many current imaging 
systems, such as PACS, are very expensive. Because of this, 
a medical center having a PACS may have only a few image 
viewing stations, used primarily by specialists such as 
radiologists. 
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The demand for network bandwidth is very "bursty" in 
traditional image viewing systems, because typically the 
entire image is transferred to the viewing station over a brief 
interval after the image is requested. Significant network 

5 bandwidth is required in order to minimize the delay in 
rendering the image. For example, transmission of a 100 
megabyte file over a network requires a large amount of 
bandwidth. Additional computer applications also require 
the transfer, over networks, of large data files. These large 
data files, such as medical images, present problems for 
servers, networks, and clients that possess limited resources. 
In addition to bandwidth, large processing resources, such as 
high-end computer workstations, are necessary to expedi- 
tiously process large data files. 

J 5 With the speed of central processing units (CPUs) dou- 
bling every eighteen months, medical professionals have 
expected medical imaging computers to achieve the same 
level of improvement in price and performance. However, in 
reality, the input/output and transmission bandwidth of these 

20 computer systems have been less successful in making 
similar advances in speed and performance. For example, to 
transmit a sixteen bit per pixel medical image with a 
resolution of 512x512 pixels, approximately thirty- two sec- 
onds is required to transmit over an ISDN line at a rate of 

25 one hundred and twenty eight kilobits per second. 
Accordingly, it is desirable to develop techniques that effi- 
ciently transfer and manipulate large data files. 

One desirable feature of some systems is the ability to 
allow a user to interact with the data file by selecting 

30 portions of the file to view. However, prior art techniques to 
transfer large data files require a user to wait an unacceptable 
amount of time to view the requested image. For example, 
it takes two seconds to receive a two kilobytex2.5 K image 
(2 bytes per pixel) via a 5 megabyte per second communi- 

35 cation link, and subsequently down sample and re-display 
less than twenty-five percent of the image data to a 1 Kxl 
K resolution display. The result of this slow downloading of 
data is compounded by some applications that require dis- 
play of multiple images during a single session, such as 

40 medical imaging applications that require display of mul- 
tiple images during evaluation. Even when employing the 
best lossless image data compression, which provides a 
three to one reduction in size, it still takes more than ten 
seconds to execute the transfer. These long latency periods 

45 render user interactive applications impractical. This band- 
width bottleneck is even more evident with the proliferation 
of Internet web applications. Also, significant resources are 
required at the client to manipulate the image in real time. 
Due to the above limitations, real-time tiser interaction with 

50 a system that displays large data files is prohibitive, if not 
impossible, using prior art techniques. Accordingly, it is 
desirable to develop a system that permits real-time user 
interaction with systems that transmit large data files over a 
network. It is also desirable to develop a system that 

55 balances the consumption of resources among server, net- 
work and client. 

One model for transferring large data files over a network 
that attempts to maximize computer resources is known as 
the thin/thick client model. For example, the thin/thick client 

60 model for picture archive and communication system 
("PACS") covers environments that include a central server 
or capture device with various classes of review stations at 
different communication bandwidths. The "thick client" 
typically consists of an expensive, high-resolution primary 

65 diagnosis station, and the "thin client" consists of one of 
numerous satellite stations with various display resolutions 
and communication links. The thick clients, which are rarely 
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configured without high-resolution monitors and a high- sentation comprises transform data sufiBcient to reconstruct 

speed communication link to the image capture device or the source data at a resolution corresponding to the level, A 

database, typically cost over $100,000. The majority imple- client application, running on the client, displays portiooa joL 

mentations for thin clients are terminals equipped with a the source data , including large images, to a user. For 
1280x1024 monitor and 10 baseT connection. For medical 5 example, the dynamic transfer syntax of the present inven- 

imaging applications, the thin client stations are typically tion has applications in medical imaging. For this 

not used for primary diagnoses, but are used as stations for embodiment, the source data includes a digitized medical 

consulting among physicians or conducting secondary diag- image generated from medical instrumentation, 
noses. To render an initial view at the client, which consists of a 

Typically, compression is used as the approach to solve portion of the source intage , the server transfers transfornT" 

bandwidth limited applications. Picture coding, using data from a lev el o f the hierarchica l re presentation co rrc- 

compression, has existed in the prior art for many decades. sponding to a jfelrSd resolutionT in~one ^bodimenT7^ 

For example, facsimile machines, video telephones, digital server transfers transtorm da la sutdcient to reconstmct alow 

video disk (DVD) players, digital satellite systems (DSSs), resolut ion view oLthe sour ce image in a view finder win3o^ 

television receivers, and digital cameras are everyday appli- (e^g75r2x512 pixel wmggwy ^FgHliis embodimen using" 

ances that all employ some type of image compression. the view finder window, the user may select ^^ ecific vie ws 

However, with all the advancement in picture coding, the ^ot^feEte- render a new view of the sourceTmlgrarthc*- 

use of compression in medical imaging is very limited. Most client, t he .client requests fr om ^ the^ 

of these compression schemes are lossy, in that data is lost form data necessjr^ ^j^^,,Eg£O ^L^^^^ 

when undergoing compression. Lossy compression is typi- ;jpccitically,'t tie cR gn l requc s t sJ^i^5^ t|^Lt^UcaD^ sfb^ 

cally unacceptable in medical imaging applications. One data corresponding toj )ixe'l' ^^iiijjes^o^^ 

reason that lossy compression is unacceptable in medical ^'^ iOI'Tft ^^^r.^^^'^jlYJi^^^^^^^^ ^ 

imaging applications is due to the potential liability from For example, the client may request transform data to zoom 

analyzing data of less than the highest informational content in on a particular section of the source image or to pan the 
possible. In addition, lossy compression introduces 25 source image. In response to the request, the server transfers 

unwanted artifacts into the medical image. Accordingly, it is to the client the additionalJcansform da^ The client recon^ 

imperative that medical images used in computer applica- structs the new view from the coefBcients transferred, 

tions are preserved in the highest fidelity possible for Accordingly, the dynamic transfer syntax system transfers 

diagnoses. Thus, there is an urgent need to identify only the transform data required to reconstruct a requested 
solutions, beyond compression, that manipulate and display ^0 image at the client, thus implementing a "just in time" data 

large images, such as medical images. delivery system. 

To reduce system bandwidth requirements without BRIEF DESCRIPTION OF THE DRAWINGS 

employing lossy compression techniques, picture coding 

using lossless techniques may be used at a limited efficiency. FIG, 1 illustrates one embodiment for a system that 

As discussed above, higher efficiencies can only be obtained employs the dynamic transfer syntax system of the present 

through use of irreversible or lossy compression schemes. invention. 

Typically, in designing systems, a choice at the onset is made FIGS. 2a-2h illustrate examples of a pyramidal data 

between the use of lossy or lossless compression. The structure. 

scalability from lossless to lossy compression is not offered, 3 ^ ^^^^^ ^-^^^^^ illustrating one embodiment for 

and there is no scalability if the picture is coded losslessly. dynamic transfer syntax system of the present invention. 

Another issue in transmitting large data files, such as ^ ^ diagram illustrating one embodiment for 
medical images, is that the screen display is often substan- dynamic transfer syntax system of the present invention, 
tially smaller than the resolution of the image itself. / j -n . * <a ^ 
Typically, pictures with re.solutions larger than the display ^ FIGS. 5a and 5fe illustrate a request/transfer operation 
size are encoded, transmitted and processed in its entirety for ^^^^ween a client and server utilizing the dynamic transfer 
subsequent display or manipulation of the image. Because of ^^^^ax system of the present invention, 
the discrepancy between the image size and the user display FIGS. 6a & 6b illustrate one embodiment for implement- 
size, the majority of the image information is discarded after ing a zoom operation for the dynamic transfer syntax system 
processing at the recipient computer, and thus the discarded of the present invention. 

information is not displayed on the monitor. For example, ' FIGS. 7a & lb illustrate one embodiment for performing 

medical images larger than 4Kx4K, such as mammograms, a pan operation, after execution of the zoom operation of 

must be cropped to fit into a limited screen space. Thus, even FIGS. 6a and 6b, utilizing the dynamic transfer syntax of the 

if the entire image is transmitted over a network, only a present invention. 

portion of the image is used in the limited screen space. The FIGS. Sa & Sb illustrate one embodiment of a chent 

problem of discarding large amounts of information is not output display for implementing a medical imaging apph- 

addressed by the current compression methods. cation using the dynamic transfer syntax of the present 

Accordingly, it is desirable to utilize all data transmitted invention. 

over a network to more efficiently use system resources. pjQ 9 illustrates a high level block diagram of a general 

cTTx>fx>rADvrio'njn ivrT/cKmr^isj ^0 purpose computer system in which the dynamic transfer 

SUMMARY OF THE IN VEN 1 ION ^^^^^^ ^^^^^^ p^^^gj^t invention may be implemented. 

A dynamic transfer syntax efficiently transfers data, DETAILED DESCRIPTION 

including large data images, from a server to at least one 

chent. Source data is transformed into a hierarchical repre- The disclosure of provisional application no. 60/091,697 
sentation. The hierarchical representation, consisting of 65 filed Jul. 3, 1998, entitled "Flexible Representation and 

essentially non-redundant data, is a plurality of levels of Interactive Image Data Delivery Protocol", is hereby incor- 

transform data, such that a level of the hierarchical repre- porated by reference. 
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Overview of Dynamic Transfer Syntax System Pyramidal Data Structure 

FIG. 1 illustrates one embodiment for a system thai The source image(s) 110 are input to decomposition 
employs the dynamic transfer syntax of the present inven- processing 120. In general, decomposition processing 120 
lion, For this embodiment, a dynamic transfer syntax system transforms the source images 110 into the dynamic transfer 
100 optionally includes imaging equipment 105 to generate 5 syntax representation, also referred to herein as pyramidal 
^ y source imag^s^l lpJoLsJg rageig^electronic f orm in an ima ge data structure 130. In general, the pyramidal data structure 
\A r T a^liiy.eOl^ . The image archTv?Tt2^ contains electronic 130 comprises a hierarchical representation of the source 
storage components such as disk drives and tape drives used image. Each level of the hierarchical representation is suf- 
to store the images in a highly reliable manner. The images ficient to reconstruct the source image at a given resolution, 
are stored in a suitable archival format, such as the above- lo In one embodiment, the decomposition processing 120 
mentioned DICOM format. The imaging equipment 105 utilizes a sub-band decomposition to generate the hierarchi- 
includes any type of equipment to generate images, includ- cal representation, in general, suD^and decomposition con- 
ing medical equipment (e.g.. X-ray equipment, CT scanners, sists of executing a process to separate "high-pass^' in for- 
and MR scanners). gation from "low -pass" information. For the sub-band 
For this embodiment, the dynamic transfer syntax system 15 decomposition emb^ilfTTritTc^ecomposition processing 120 
^ 100 includes at leasUme.seo:£cl40 and one or more clients, comprises a finite impulse response (FIR) filter. 

each labeled 150 on FIG. 1 . The server 140 and client(s) 150 In one embodiment that uses sub-band decomposition, the 

•^ are coupled via a ngjwork 160. As shown in FIG. VtRc decomposition processing 120 uses wavelet transforms, ^5-^ 



arc coupled via aji£j^orkl60. As shown in FIG. 

source image(s) HO, subse^^t to decomposition process- which are a sub-class of the sub-band decomposition trarfs- 

ing 120, are distributed to one or more servers 140. In turn, 20 general, the wavelet transform may be selected so 

the source image(s) 110 are available to a number of clients that the kernels aggregate a sufiScient amount of the image 
150. In general, the server(s) 140 are general-purpose com- information into the terms or coefficients. Specifically, the 
puters having storage and communication resources information is aggregated into the *iow low" com ponen^^ 
adequate to service one or clients 150. The client(s) 150 the.dec.Qm ^sitiotT^CSee the "low low" compojient shTwrTin 

computers include, at a minimum, a graphic display and a 25 EI£S.-2£U-Zd,-2£*.^S_and^2/i). As 'describeii more fully 
user interface that permits zooming, panning, and other below, in one embodirncruTEemels of the wavelet transform 
image-manipulation functions. In one embodiment, each are selected so as to balance the computational efficiency of 
server 140 may be associated with a particular "context" of the transform with optimization of the aggregate information 
image viewing. For example, one server 140 may be avail- in the low pass components. (This characteristic of wavelet 

able to a radiology department, and an associated client(s) 30 transforms permits transfer, and subsequent display, of a 
150 may be used primarily by radiologists. Another server good representation of the source image at a particular 
140 may be used primarily for teaching or research pur- resolution while maintaining the computational efiBciency of 
poses. Each context may have different requirements for the transfonm.^ 
image access and use, and so the use of context-specific The wavelet transform function embodiment generates 

servers can provide desirable flexibility and tailoring of the 35 mathematically independent information among the levels 
system to optimize the use of resources. of the hierarchical representation. Accordingly, there is no 

The source image 110 is processed, by decomposition redundant information in the pyramidal data structure 130. 
processing 120, to generate a pyramidal data structure 130. Thus, pyramidal data structure 130 is not merely multiple 
For this embodiment, the server 140 transmits to client(s) replications of the source image at different resolutions, 

150 transfonmations of the source image 110, stored as 40 which consists of redundant information, but it contaj ns 
pyramidal data structure 130, to re-create images and sub- unique data at the different levels of the hierarchlcaTrepre^- 
images in the client(s) 150. The dynamic transfer syntax sentatifin^As is described more fully below, the mamematr- 
system 100 transfers only the coefficient data required to cally independent S^li^^o^^j^^^^^^l^^J^^ 
r^econstaicy^_re3i^^ aT the client(s), thus imple- minimiz ing the amounToytlMa^ra isEerm^^ 

gienting a "ju'sT in time" data delT yg ry " bystem - . - ^ is 45 by requiring only^theacapsfe^fLl^adjjUoi^^ yet 
described more fully below, the technidJtlH^ of the dynamic traiisferred toji^e cU entJronUh^e, sju^^ ''^^ 
transfer syntax system permit use of a network 160 with s^^^^^^TThe waveieUransforms a^y^^pn^^^ 
moderate bandwidth capacity, while still providing low that no data from the original source image is lost in the 
latency for transfer of large data files from server 140 to decomposition into the pyramidal data structure 130. 

clients 150. For example, network 160 may utilize an 50 Accordingly, the dynamic transfer syntax system of the 
Ethernet (10 baseT) medium or an ISDN transmission present invention has applications for use in medical imag- 
medium. Regardless, any network, including wide area ing and medical imaging applications, 
networks (WANs) and local area networks (LANs) may be In one embodiment, fixed point kernels are used in the 

used with the dynamic transfer syntax system without devi- wavelet transform (i.e., decomposition processing 120). The 

ating from the spirit and scope of the invention, 55 use of fixed point kernels generates coefficients for the 
The dynamic transfer syntax system 100 processes one or pyramidal data structure that permit an easy implementation 
more source images 110. Generally, the source image 110 into a standard pixel footprint. SlEJg ^^^^^^^^fi™> ^ 
comprises any type of a large data file, and in fact the source spatial transform , generates a dynamic™range"o"rthe^ "lowS; 
image 110 may comprise any type of large data file for low" component that is equal to the dynamic range of the 

transfer over a network environment. In one medical imag- 60 source image. Because of this characteristic, the "low low'* 
ing application, the source image 110 includes a digitized component does not contain "overshoot" or Gibb's effect 
medical image generated from medical instrumentation undershoot components. As a result, the use of fixed point 
(e.g., mammogram, X-Ray, MRl, CATSCAN, etc.). kernels is preferred because no normalization process to 
Although the present invention is described for use in convert the transformed dynamic range to the pixel dynamic 

processing, transferring, and displaying medical images, any 65 range is required, 

large data file may be used as a source image 110 without For this embodiment, the dynamic transfer syntax system 
deviating from the spirit or scope of the invention. directly utilizes the transform coefficients as pixels, without 
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re-scaling ihe coefiBcients. Tlie range of the high-pass com- transform data may be used to reconstruct a source image in 

ponents (i.e., "low high", "high low", and "high high" three dimensions. Also, the muUi-spectral transform data 

components) is the range of the input source data plus up to may comprise any type of attribute for binding to the source 

four bits per coefficient. This characteristic permits mapping image, such as color variations and/or non-visual compo- 
of all components (i.e., high and low pass components) to a 5 nents (e.g., infrared components). 

given pixel footprint. For example, source data sampled into In general, to generate the pyramidal data structure 130, 

twelve bit input samples may be stored in a sixteen bit ^^e transform is applied across ibfi^CQlumns. and then this 

format. For this example, each coefficient in the low-pass transform, or a diEferent ^transform, is ap^d a^ro^the 

component (i.e., "low low" component), comprises twelve rows. T he selection of the transform tor decompHSttion 
bits. The twelve bit low-pass component may be stored in lO processing 120 is dependent upon the particular character- 

^^i xteen bit form at. Each coefficient for the "low high" ^^'"^ ^^e pyramidal data structure desired. Each level of 

'^and ^h low" components comprises fourteen bits (i.e., ^^e pyramidal data structure is generated by recurrmg on the 

(B+2) bits per coefficient, where B is the input pixel depth low-pass. "low low", of the previous higher level. Ihis 

per pixel), also suitable for storage in the sixteen bit format. recursion continues until a .predfttm^ined size is obtained. 

The "high high" component consists of sixteen bits for each 15 example, in one embodiment, the lowest level m the 

coefficient (i.e., (B +4) bits per coefficient, where B is the pyramidal data structure for a source image having an aspect 

input pixel depth per pixel). Thus, the "high high" coeffi- ^atio of one-to-one consists of a low-pass component of 

cients may also be stored in the sixteen bit format, 128x128. However, any granularity of resolution may be 

„ . . 1 . . f . * *u • generated for use in a pyramidal data structure without 

The use of the wavelet transform to generate the pyrami- j • r • •* f*i- • *■ ai 
, , , . , , . t 1 - r- /• in deviating from the spint or scope of the invention. Also, any 

dal data structure provides a scalable solution tor transrer- ^ T i- j**t- • '*u 

. i'*'^ " , ^^.aiauiv I I I quadrant may be used in the recursion process with any 

nng different portions of a large data file. When the source desired transform 

image 110 is decomposed into the pyramidal data structure „_„ -i, n * . , c j i ^ * 

^^J^ , . J u 1 • ^ ♦ ^ FIGS. 2a-2n illustrate examples of a pyramidal data 

130. sub-ima ges and sub-resolu tion images are extracted i u - 

^ic^[b^^^^amonh^rvcr MO-TleseTVeTPmilf, ^^'^^ this example, the source .mage compnses a 
tVlli iiik^nlvXd^^ coefBd ents, 25 4Kx4K .mage^ The decomposition processing 20 

' r— T- ^ ; — -*r — ' I iiuIj — ' ^A ^.r* '^, generates, m a first iteration, a level one Mallat structure 

reauiredlQJce cQiistruct the exact size ot ttie desired miagelor \ . ' o c u u - r-m i 

j-rH — " " . V — * A ■ j~ 1 ':c — — it' i shown m FIG. 2a. Specifically, as shown in FIG. 2a, a 

djsplav^itJJiewClifent. Accordingly, the multi-resolution ror- , . « V , » • . j j • / p 

'^■T . " . , ^ — - • J 1 J . * . low-pass component, low low" is generated and consists of 

mat is implicit in the pyramidal data structure. ^i/ot^ t-u u- u 

^ .a 2Kx2K sub-image. The high-pass components, consisting 

The information in the pyramidal data structure^ essen- .^^^ ^-^^.^^ .^igh high", and "high low", contain physical 

tially non-redundant. Each level of the pyramidal data coefficient coordinates as shown in FIG. 2a (e.g., the upper 

structure comprises information sufficient to reconstruct the ^^^^ ^^^^ coordinate for the rectangle that constitutes the 

source image at a resolution correspondmg to that level. .j^^ ^-^^^ component is (4K, 0)). RG. 2b illustrates an 

However, the different levels of the pyramidal data structure example source image to illustrate one embodiment for 

are not merely repHcations of the source image at different decomposition processing. FIG. 2c illustrates a level one 

resolutions. Instead, each level of the pyramidal data stnic- j^^j^^j transform of the columns of the source image shown 

ture comprises a umquc set of coefficients. pjQ 2b, FIG. 2d illustrates a level one Mallat transform 

A wavelet transform is a spatial transform. In general, in of the columns and rows of the source image shown in FIG. 

a spatial transform, the information is aggregated so as to 2b. 

preserve the predictability of the geometry of the source piQ 2e illustrates a second level decomposition for the 

image. For example, using a wavelet transform with fixed example of FIG. 2a. As shown in FIG. 2e, the second 

point kernels, specific coefficients of the transform data may iteration of decomposition processing 120 operates on the 

be identified that contribute to specific geometric features of ^^^ ^ u^^^ j^^^.^^^ component of the level one data, 

the source image (i.e.. a pre-defined portio n of a source p^j. j^e second level, the low-pass component, "low low", 

ihiaae is directly identifiable in the transfor m dataj. In consists of a IKxlK sub-image. HG. 2/ illustrates a level 

contrast, a spectral transtorm aggregates-rne iniormation of ^wo Mallat transform for the source image shown in FIG. 2d. 

the source image across a frequency spectrum, and thus docs piQ 2g illustrates a level three decomposition for the 

not preserve the ability to predict the geometry of the examples of FIGS. 2a and 2e. To generate the level three 

original source image from the transform data. decomposition, decomposition processing 120 operates on 
In another embodiment, the wavelet transforms use float- 50 the level two "low low" component of FIG. 2e (i.e., the 

ing point kernels. The use of floating point kernels generates 2Kx2K image). For the level three transform, the low-pass 

an aggregated higher percentage of information in the "low component, "low low", is a 5 1 2x5 1 2 sub -im a^e . F IG . ^2h 

low" component of the pyramidal data structure. However, il lustrates a fourth level of decomposition for t h e cxaffi Blg^of 

in implementation, the use of floating point kernels has FIG. 2g. hor the level four t^anst^^m^thel5a ^ 
several disadvantages over the use of fixed point kernels. For 55, nent comprises a sub-imat^e oi_25hxZ^6 pixels , 

example, use of the floating point kernels requires normal- in one embodiment, the wavelet kernel comprises the 

ization of the coefficients to convert the coefficients in the wavelet kernel in the Ricoh Crew Image Compression 

pyramidal data structure 130 to pixel data for display at the Standard proposal and is derived from D. LeGall and A. 

chent. Tabatabai, See "Sub-band coding of digital images using 
In another embodiment, the wavelet transform of the 60 symmetric short kernel filters and arithmetic coding 

present invention may used to generate multi-spectral trans- techniques," IEEE International Conference on Acoustics, 

form data. In general, multi-spectral transform data aggre- Speech and Signal Processing, New York, N.Y, pp. 

gates multi-components of the source image into a vector for 761-765, 1988. Anv_sub-b ''"'i K^^fTl^l in^ PV^"^'^ ir^ncFnrm 

the transform data. Through use of multi-spectral transform could be_u s ed y^\\]\\}\ the, infrastmrinrr, df.snrihed bv DTS : 
data, the wavelet transform may aggregate multi- 65 however, an integer kernel with no coefficient growth in the 

dimensional data (e.g., two dimensional, three dimensional, low pass term has particular advantages in that the low pass 

etc.) for a source image. For example, multi-dimensional coefficients can be used without processing as pixels, and the 
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transform can be inverted exactly in the integer domain. 
Although floating point kernels can have superior signal 
transfer characteristics, the additional processing required to 
use these coeflGcients as pixels, and the need for additional 
storage lo guarantee perfect reconstruction works to their 
disadvantage. 

The kernel consists of a low pass and a high pass 
biorthogonal filter. With input defined as {dy} and [x] defined 
as the floor function, the forward transform is: 

Lowl;-]-[(V^2,>x)/2] 
High(2]=c/,,^rf:^-,,+Poly[i] 

Polyl;14 (3 • w(/-2 J-22 • I^wL/- 1 1+22*Udw[;+ 1 ]-3 • l^w[;+^^ 
32)/64] 

The inverse transform, used to reconstruct the image, is: 
t/2rLowl/']+[CHigh[/>Poly[;l+l)/2] 
d2^,,»Low[;>[(High|;-]-Poly[;-D/2l 

Dynamic Transfer Syntax Session 

FIG. 3 is a block diagram illustrating one embodiment for 
the dynamic transfer syntax system of the present invention. 
This embodiment illustrates a server, storing a pyramidal 
data structure 130, and a client running a client application. 
In general, the client application 340 may comprise any type 
of application that permits a user to view or manipulate data 
downloaded from a server. In one embodiment, client appli- 
cation 340 is software running on a general purpose com- 
puter that permits a user to view mcdical__irnag£|_down- 
loaded f rpniJlie-ser^er3sfeSg Ag'5tTbwtni^^ 
transferred across the network 160 to effectuate communi- 
cation between the server 140 and a client 150. The server 
130 contains server-network protocol 310, and the client 
contains client-network protocol 320. As described more 
fully below, these modules implement a network protocol to 
transmit the packets across network 160. 

The client application 340 receives user input from an 40 
input control device, such as keyboard 370 and a cursor 
control device. For example, the user input may generally 
define selection by a user to pan or zoom on an image. In 
turn, |he clie nt application 340 fi^^^^a^^s th e pixel 
coordinaTB^^uollff^^ 

"S^ne^ffi^^age area and the resolution of the source image 
selected^^^TKTuserTofexa^^ 
in on a pafticiiraTportion of the source image, then the client 
applicati on 340 s pecifies the pjxe l^cyordin atesjhat^ 
^"•^ ^'a 6t tfiFi^5^iandjhe_zo^:;^acX^ 50 
receives the pixel coordinates, and generates physical coef- 
ficient coordinates that map to the pixel coordinates. The 
physical coefficient coordinates define the range of 
coefficients, stored as the pyramidal data structure, neces- 
sary to re-construct the image defined by the pixel coordi- 55 
nates. One embodiment for mapping pixel coordinates to 
physical coefBcient coordinates is described more fully 
below in conjunction with FIG. 4. tTipcp phygjpfi] ^npfRripnt 
coprdinatc s ^re then transferred, as a request, frgjp the client 
150 to thi Isktwf-440. ^ """" 60 

In response to the client request, the server 1 'to rficeiv^5;_ 
the coefScient coord inf?^^-'^i flfli^ tra nsmits^ over the network 
160, the coeftlcientsidentified by the coefficient coordinates7 
This data flow is indfcated by the arrows in FIG. 3. The 
client 150 receives the coefficiejU ts^jiad-iJfocessea the coef^ 65 
ficients in transform pro cessing 350. TcaD Sfoiaa^ptQcessiaft. 
355~is tne reverse transiorm used in decom position process- 



35 



ing 120JFIG . 1). The pixel data is input to a frame buffer 
j60Lof the" geggT Ql pu rpo s g'Coi a^Uiei ' syiSieui, fui subiJ gqu ent 
'His play on T iK^nTDSlTofiN O. ' ~~ 

^ In one embodiment^^two distinct types of interfaces exist 
between the server 140 and a client 150. One interface is 
referred to as an "asynchronous channel" or AC 142. The AC 
142 interconnects the server network protocol manager 310 
with a master client process (not shown) located in the client 
150. The other interface is referred to as a "synchronous 
channel" or SC 144. The SC 144 interconnects the server 
network protocol manager 310 with the transform process- 
ing 350 located in the client 150. The AC 142 is used 
primarily for the signaling of requests and responses 
between a client 150 and a server 140. One primary function 
carried out via the AC 142 is the establishment of SCs 144. 
The SCs 144 are used primarily for the delivery of image 
data. The AC 142 employs communications messages using 
"key value pair" syntax to provide flexibility and tailorabil- 
ity. Each message includes a number of text strings of the 
form "variable =value", where "variable" is a string identi- 
fying some aspect of the message, and "value" is a string 
identifying a particular value for this attribute. Examples of 
the use of key value pairs in AC messages are given below. 

The SC 144 is tailored for the expedient request and 
delivery of image data between the server network protocol 
manager 310 and the client network protocol manager 320. 
The communications protocol via the SC 144 employs as 
little overhead as possible in order to speed message pro- 
cessing. This feature enables the tailoring of data request and 
delivery messages to enhance eflBciency and/or perfor- 
mance. 

The coefficients are requested from the client 150 in 
blocks. In one embodiment, each block is specified by an 
upper left vertex and a lower right vertex. The maximum 
block size for a request depends on the maximum input/ 
output buffer size implemented on the SC 144. This buffer 
size is a function of the underlying network transport 
mechanism. For each set of coefficients being requested, the 
server 140 breaks the coefficients down into a number of 
blocks of this size or smaller, and then requests the blocks 
individually by specifying their respective vertices in 
respective block request messages. The protocol of the SC 
44, therefore, is a very simple protocol that handles requests 
for blocks of data and the delivery of the data blocks. 
Messages are very easy to format and decode, and therefore 
the SC 44 can be operated in a fast and efficient manner. 

After mapping pixel coordinates to physical coefficient 
coordinates (block 330), client network protocol manager 
310 breaks the coefficient request into network friendly 
block requests. For this embodiment, the block request is 
composed of 7 short parameters that describe the exact 
location of the desired coefficient block as follows: 



Shoit[0] - 1 


used to test byte swap 


Shoit[l]= 0 


Raw Request Command 


Short[2] - XO 


Start Xdim 


Short(3] = YO 


Start Ydim 


Short{4] = XI 


End Xdim 


Shoit(5] ~ Yl 


End Ydim 


Shoit(6] = Slice 


Slice number 



The server network protocol manager 310 gathers informa- 
tion and returns a nne Himt^niSinnt^] arr;vy-f;^f shn*-! paramf^tRrc 
wher e the number of ele ments in the arr ay is (XI -XO )* 

^s^mz — 

The operational flow described in FIG. 3 illustrates the 
"just in time" data deli^rv Q^J*^'N.dy_Tv;,"iic.^rarisfer syntax 
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system 100. Specifically, note that only the incremental 
coefficients necessary to re-construct the requested image is 
transferred from the server 140 lo the client 150. This 
process eliminates unnecessary transfer of data that is not 
displayed on the monitor 380. s 

FIG. 4 is a flow diagram illustrating one embodiment for 
the dynamic transfer syntax system of the present invention. 
For this embodiment, to initiate transfer of data from the 
server to the client, the server transfers an initial view to the 
client in response to a request from the server (block 410, lo 
FIG. 4). In one embodiment, the initial view is displayed in 
a small screen area (e.g., 512x512 rendition of the source 
image). One embodiment for initially displaying the source 
image in a reference window is described in conjunction 
with FIG. a. The client application (block 340, FIG. 3) is 
permits a user to select a new view of the source image. For 
example, the user may select a new view by selecting an 
image area to increase the magnitude of the resolution for 
the new view (i.e., zoom in on a particular area of the source 
image). Regardless of the technique, if a user selects a new 20 
view, then the client application determines the pixel coor- 
dinates of the new view (blocks 420 and 430, FIG. 4). The 
pixel coordinates define, relative to the source image, the 
image area and resolution for the new view. The pixel 
coordinates, for the new view, are then mapped to coefBcient 25 
coordinates to identify coefiScienls in the pyramidal data 
structure (block 440, FIG. 4). 

In one embodiment, the decomposition processing 120 
(FIG. 1) uses the wavelet transform. There is a one-to-one 
correspondence between pixel coordinates and coefficient 30 
coordinates, and thus no re-scaling is required. The follow- 
ing example illustrates mapping from pixel coordinates to 
physical coefficient coordinates. For purposes of 
nomenclature, the coordinates define a rectangle of 
coefficients, such that the first coordinate [x^, yj represents 35 
the upper left coordinate of the rectangle, and the second 
coordinate, [x2, y2], represents the lower right hand corner 
of the rectangle. The relative sizes and locations of the 
coefficients are the same with respect to the size and location 
the original image. Thus, the indices of the coefficients at aq 
any level can be derived from the coordinates [x^, y^] and 
[x^, y2] by shifting (to account for the relative position of a 
rectangle of coefficients at a given level) and scaling (to 
account for the relative size of the rectangle of coefficients). 

For this example, the initial view is displayed in the entire 45 
area of the source image in a 512x512 reference window. 
Thus, the transform processing 350 (FIG. 3) includes the 
coefficients at the coordinates: 
ti 3[0,0][4K, 4K] 

50 

This example assumes a 4Kx4K source image. The "3'* 
represents that the initial image, 512x512 in size, requires 
level "3" coefficients to render. For this example, the client 
application selects, for the initial view, dead center at the 
pixel coordinates of [IK, IK] [3K, 3K]. This requires 55 
coefficient coordinates of: 

21 IK, 1K][3K, 3K] 

After defining the physical coefficient coordinates 
required for the new view, the client application requests the 60 
additional coefficient coordinates required to display the 
new view (block 450, FIG. 4). For the example discussed 
above, the client requests "2 [IK, IK] [3K, 3K]" to represent 
the additional physical coefficients coordinates needed to 
display the new view. The physical coefficient coordinates 65 
are transferred over the network to the server, and in 
response, the server transfers the coefficients identified by 



t he coefficiem c oordinatesiblock 460, FIG. 4).^^|l&i;j£csiv^ 
^ing the coeffic lengn^ ^li'^nt itnrfltivi^lv Hiildfi ^hr n^" 
ir iiuuu f ium tttiT ^Htfcknt coordiaaifis«iF€m*£aGb=4£Y^l» 

jamidal ( 
(biock 



FIG. 4). 

FIGS. 5a and 5b illustrate a request/transfer operation 
between a client and a server utilizing the dynamic transfer 
syntax system of the present invention. This example, the 
client display size is 1280x1024 pixels, and the source 
image is 2Kx2K. To initiate the process, the cHent requests 
a 512x512 resolution of the source image as shown in FIG. 
5a. For this example, a 512x512 sub-image constitutes a 
second level sub-image in the pyramidal data structure. In 
response to the request, the server transmits the low-pass 
component for the level three decomposition. This "low 
low" sub-image is highlighted on the source image in FIG. 
5a. FIG. Sb illustrates the display of the 512x512 low-pass 
sub -image on the client display. As discussed above, for the 
initial window size of 512x512, the low-pass component is 
the best representation of the source image that can be 
displayed in a 512x512 window. 

FIGS. 6a & 6b illustrate one embodiment for implement- 
ing a zoom operation for the dynamic transfer syntax of the 
present invention. As shown in FIG. 6a, as an initial view, 
the client displays, in a 1280x1024 window, a 512x512 
image. The 512x512 image, a level two decomposition for 
a 2Kx2K source image, consists of the entire source image 
in the smaller display window. The client requests additional 
coefficient coordinates sufficient to display a portion of the 
source image at a higher resolution (i.e., physical coordi- 
nates to execute the zoom operation). As shown in FIG. 6b, 
in response to the request, the server transmits three packets 
of coefficients, each consisting of 256x256 coefficients, lo 
display the new view at the higher resolution. Note that the 
high-pass coordinates transferred provide the additional 
information necessary to generate the new image. The boxes 
labeled 750, 760 and 770 depict the high-pass coefficients 
necessary to generate the new image at the higher resolution. 

In one embodiment, the client application supports the 
panning of the source image. In general, panning consists of 
viewing, in virtual real-time, portions of the larger source 
image on the smaller client display. One embodiment for 
implementing panning in a medical imaging application is 
described below in conjunction with FIGS. 8a & 8Z?. FIGS. 
7a & 7b illustrate one embodiment for performing a pan 
operation utilizing the dynamic transfer syntax of the present 
invention. The pan operation example of FIGS. 7a and lb 
occurs after execution of the zoom operation illustrated in 
FIGS. 6a and 66. As shown in FIG. 7a, the client displays, 
in a portion of the 1280x1024 display, an initial image. The 
initial image is a portion of the entire source image at a 
resolution greater than the resolution required to display the 
entire source image on the client display. For example, the 
initial image may comprise approximately one half of the 
source image at full scale (e.g., a 1024x1024 image con- 
sisting of the top half of the 2kx2k source image). To view 
a different portion of the source image (i.e., pan the source 
image) after the zoom operation of FIGS, 6a and 6i) has been 
executed, the client requests a pan operation by transmitting 
the physical coefficient coordinates necessary to generate the 
new view (i.e., the portion of the zoomed source image 
being panned). For the example of FIGS. 7fl & 7b, to pan a 
portion of the source image, four packets of coefficients, 
each consisting of 16x256, are transmitted from the server 
to the client via the network. The additional coefficients 
required for the example pan operation are graphically 
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illustrated as boxes 610, 620, 630 and 640, As a result, the 
client processes the coefficients to generate the pixel data for 
the pan operation for display on the client display. 

The foregoing description of the dynamic transfer syntax 
assumes that previously-requested coefiBcicnts are retained 5 
in a cache or other memory while the image is being viewed, 
and can be retrieved from the memory as necessary for 
decoding regions of the image. It may be desirable in 
alternative embodiments to forego such a memory, for 
example to reduce cost. In such memory-less embodiments, 
the client 150 requests all the coefficients necessary to 
decode a desired region, whether or not they had been 
previously requested. 

Medical Imaging Applications 

FIGS. 8a & Sb illustrate one embodiment of a client 15 
output display for implementing a medical imaging appli- 
cation using the dynamic transfer syntax of the present 
invention. For this embodiment, the client application (block 
340, FIG. 3) is tailored for a medical application. 
Specifically, the client application permits a viewer, such as 20 
a doctor or other medical professional, to view large source 
images, such as X-rays, at various views and resolutions on 
a primary display area of the client output display 800, 
labeled view window 810 in FIG. 8a. For this embodiment, 
a small display window, entitled reference window 820, is 25 
displayed in the lower left comer of the client output display 
800. The reference window 820 permits a user to view large 
portions of the image, at low resolution, for selection of 
sub-images within the larger source image. In one 
embodiment, the server transfers a low resolution full image 30 
view of the source image for display in the reference 
window 820. For example, if the source image is a 2Kx2K 
image, and the reference window comprises 512x512 pixels, 
then the server transmits level two low-pass coefficients to 
represent the source image in the 512x512 reference win- 35 
dow. 

The general operation of the a medical application 
deploying the dynamic transfer syntax system follows. An 
image in DICOM format is received from the image archive 
112 of FIG. 1, or in alternative embodiments, an image is 40 
received directly from imaging equipment 105. The image is 
wavelet encoded (decomposition 120), and the resuUing 
encoded image is stored within the server 140. In one 
embodiment for a medical application, the image is logged 
into an image database (not shown), accessible by a client 45 
150, in order to select the image for viewing. For example, 
the images for a particular patient may be logged in a 
manner to associate the image with a medical record for the 
patient. When the client 150 accesses the patient's medical 
record, an indication of the image appears. In one 50 
embodiment, this indication may take the form of a thumb- 
nail sketch of the image, (displayed in the reference window 
820), along with identifying data such as a title (e.g., "Chest 
X-Ray) and date. 

Using the AC 140 (FIG. 1), the client 150 requests the 55 
image for viewing. The request message includes an iden- 
tifier of the image in the database. The server 140 responds 
by forwarding the request to an image service, which in turn, 
creates an instance of an image process specifically associ- 
ated with the requested image and the requesting client. The 60 
image service returns information to the client 150 that 
enables the client to establish communications with the 
image process via a SC 144. This information may take the 
form, for example, of an host IP address and port number. 
The master client forwards this information to the client 150, 65 
which then establishes the SC 44 with the image process. 
Once the SC 44 is established, the image may be viewed. 
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In alternative embodiments, the image process may reside 
on a different server from the server on which the master 
server process and/or the image service resides. In such 
embodiments, the communication between components 
takes the form of remote procedure calls or other network 
communications mechanisms. Also, there may be multiple 
clients 150 accessing a single image instance, for example to 
enable geographically separated colleagues to collaborate in 
real time on a study or diagnosis. In such embodiments, the 
master server process and image service include functions 
that enable a client 150 to locale and connect to an existing 
image process. 

The client application controls 830, shown in FIG. 8fl, 
comprise the means to permit the client to select functions 
to view portions of the source image. In one embodiment, 
the client application controls 830 permits a user of the client 
system to pan the source image in virtual real-time. As 
shown in FIGS. Sa & 8^, the client application includes a 
cursor 830 that permits moving a select box 850 within the 
reference window 820. The select box 850 defines a region 
for the user to select a new view of the source image at a 
greater resolution. For example, by allowing the user to 
place the select box over a portion of the image in the 
reference window with a pre-defined zoom factor, user input 
is generated to execute a zoom operation. Also, by allowing 
the user to move the select box over a portion of the image 
in the reference window, user input to execute a virtual real 
time panning operation is generated. For the virtual real lime 
panning operation, the area encompassed by the select box 
850 is displayed on the view window 810 al a predetermined 
resolution in response to the movement of the select box 
850. The operation is performed in "virtual real-time" 
because as the user moves the select box 850 in the reference 
window 820, the client/server, using the dynamic transfer 
syntax, displays that portion on the view window 810. 

In one embodiment, the client application controls 830 
also provides the functionality to zoom in on a portion of the 
source image identified by the select window 850. For this 
operation, the user, using the cursor 830, moves the select 
box 850 across the reference window 820 to select a desired 
portion of the source image. Once identified, the zoom 
command is executed, either through a pull down menu or 
keystroke, to select the portion of the source image to view 
in the view window 810. The pan and zoom operations are 
graphically illustrated in FIGS. 8a and 8b with the display 
in the reference window 820 of FIG. 8a of a selected portion 
of a source image, selected using the select box 850, and 
with the display of the selected portion of the source image 
shown in the view window 810 of FIG. 8b. 

Computer System 

FIG. 9 illustrates a high level block diagram of a general 
purpose computer system in which the dynamic transfer 
syntax system of the present invention may be implemented. 
A computer system 1000 contains a processor unit 1005, 
main memory 1010, and an interconnect bus 1025. The 
processor unit 1005 may contain a single microprocessor, or 
may contain a plurality of microprocessors for configuring 
the computer system 1000 as a multi -processor system. The 
main memory 1010 stores, in part, instructions and data for 
execution by the processor unit 1005. If the dynamic transfer 
syntax system of the present invention is wholly or partially 
implemented in software, the main memory 1010 stores the 
executable code when in operation. The main memory 1010 
may include banks of dynamic random access memory 
(DRAM) as well as high speed cache memory. 

The computer system 1000 further includes a mass stor- 
age device 1020, peripheral device(s) 1030, portable storage 
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medium drive(s) 1040, input control device(s) 1070, a 
graphics subsystem 1050, and an output display 1060, For 
purposes of simplicity, all components in the computer 
system 1000 are shown in FIG. 9 as being connected via the 
bus 1025. However, the computer system 1000 may be $ 
connected through one or more data transport means. For 
example, the processor unit 1005 and the main memory 
1010 may be connected via a local microprocessor bus, and 
the mass storage device 1020, peripheral device(s) 1030, 
portable storage medium drive(s) 1040, graphics subsystem 
1050 may be connected via one or more input/output (I/O) 
busses. The mass storage device 1020, which may be 
implemented with a magnetic disk drive or an optical disk 
drive, is a non-volatile storage device for storing data and 
instructions for use by the processor unit 1005. In the 
software embodiment, the mass storage device 1020 stores 
the dynamic transfer syntax system software for loading to 
the main memory 1010. 

The portable storage medium drive 1040 operates in 
conjunction with a portable non-volatile storage medium, 20 
such as a floppy disk or a compact disc read only memory 
(CD-ROM), to input and output data and code to and from 
the computer system 1000. In one embodiment, the dynamic 
transfer syntax system software is stored on such a portable 
medium, and is input to the computer system 1000 via the 25 
portable storage medium drive 1040. The peripheral device 
(s) 1030 may include any type of computer support device, 
such as an input/output (1/0) interface, to add additional 
functionality to the computer system 1000. For example, the 
peripheral device(s) 1030 may include a network interface 30 
card for interfacing the computer system 1000 to the net- 
work 160. For the software implementation, source images 
110 and the hierarchical representation of the pyramidal data 
structure 130 may be input to the computer system 1000 via 
a portable storage medium or a network for processing by 35 
the dynamic transfer syntax system. 

The input control device(s) 1070 provide a portion of the 
user interface for a user of the computer system 1000. The 
input control device(s) 1070 may include an alphanumeric 
keypad for inputting alphanumeric and other key 40 
information, a cursor control device, such as a mouse, a 
trackball, stylus, or cursor direction keys. In order to display 
textual and graphical information, the computer system 
1000 contains the graphics subsystem 1050 and the output 
display 1060. The output display 1060 may include a 45 
cathode ray tube (CRT^ display, a liquid crystal display 
(LCD), or a flat panel display. The graphics subsystem 1050 
receives textual and graphical information, and processes 
the information for output to the output display 1060. The 
components contained in the computer system 1000 are 50 
those typically found in general purpose computer systems, 
and in fact, these components are intended to represent a 
broad category of such computer components that arc well 
known in the art. 

The dynamic transfer syntax techniques may be imple- ss 
mented in either hardware or software. For the software 
implementation, the dynamic transfer syntax system is soft- 
ware that includes a plurality of computer executable 
instructions for implementation on a general purpose com- 
puter system. Prior to loading into a general purpose com- 60 
puter system, the dynamic transfer syntax system software 
may reside as encoded information on a computer readable 
medium, such as a magnetic floppy disk, magnetic tape, and 
compact disc read only memory (CD-ROM). In one hard- 
ware implementation, the dynamic transfer syntax system 65 
may comprise a dedicated processor including processor 
instructions for performing the functions described herein. 
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Circuits may also be developed to perform the functions 
described herein. 

Although the present invention has been described in 
terms of specific exemplary embodiments, it will be appre- 
ciated that various modifications and alterations might be 
made by those skilled in the art without departing from the 
spirit and scope of the invention. 

What is claimed is: 

1. A method for transferring data from a server to at least 
one client, said method comprising the steps of: 

transforming source data into a hierarchical representa- 
tion tising a wavelet transform with fixed point kernels, 
said hierarchical representation comprising a plurality 
of levels of essentially non-redundant data, wherein a 
level of said hierarchical representation comprises 
transform data sufficient to reconstruct said source data 
at a resolution corresponding to said level; 

requesting, from a client to a server, transform data from 
a level of said hierarchical representation necessary to 
reconstruct at least a portion of said source data; 

transferring, from said server to said client, said transform 
data from said hierarchical representation requested by 
said client; and 

re-constructing, at said client, said portion of said source 
image for display at said client with said transform 
data. 

2. The method as set forth in claim 1, further comprising 
the steps of: 

requesting, from said client to said server, transform data 
from said hierarchical representation necessary to 
reconstruct a new portion of said source data; 

transferring, from said server to said client, additional 
transform data from a level of said hierarchical 
representation, corresponding to said new portion of 
said source data, down one or more lower levels of said 
hierarchical representation to said level previously 
transfenred; and 

reconstructing said new portion of said source data with 
said additional transform data and said transform data 
originally transferred, whereby only incremental trans- 
form data necessary to construct said new portion of 
said source data at said client is transferred from said 
server to said client. 

3. The method as set forth in claim 1, wherein: 

the step of transforming said source data into a hierarchi- 
cal representation comprises the step of utilizing said 
wavelet transform to generate a plurality of low pass 
coefficients and a plurality of high pass coefficients; 

the step of requesting data from said hierarchical repre- 
sentation comprises the step of transferring coefficient 
coordinates to identify coefficients sufficient to 
re-construct said portion of said source image; and 

the step of re -constructing said portion of said source 
image comprises the step of transforming said coeffi- 
cients to generate said portion of said source image. 

4. The method as set forth in claim 3, wherein the step of 
utilizing said wavelet transform to generate a plurality of 
low pass coefficients and a plurality of high pass coefficients 
comprises the step of generating low pass coefficients for 
each level of said hierarchical representation, so as to 
aggregate sufficient information to render a viewable display 
of said source image at a resolution corresponding to said 
level. 

5. The method as set forth in claim 3, wherein the step of 
requesting, from said client to said server, transform data 
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comprises the step of transferring 0(N) coefficients to rep- 
resent ''N" pixels for display at said client, wherein "N" 
comprises an integer value. 

6. The method as set forth in claim 1, wherein the step of 
transforming said source data into a hierarchical represen- 5 
tation comprises the step of executing a finite impulse 
response function to generate said transform data. 

7. The method as set forth in claim 1, wherein the step of 
transforming said source data into a hierarchical represen- 
tation comprises the step of preserving geometry between 
said source data and said transform data, so that any portion 
of said soiorce data is identifiable from a portion of said 
transform data. 

8. A method for transferring data images from a server to 
at least one client, said method comprising the steps of: 

generating a hierarchical representation of a source image 
using a wavelet transform with fixed point kernels, said 
hierarchical representation comprising a plurality of 
levels of essentially non-redundant data, wherein a 
level of said hierarchical representation comprises data 
sufficient to reconstruct said source image at a rcsolu- 
tion corresponding to said level; 

transferring, from a server to a client, at least a portion of 
data from a level of said hierarchical representation of 
said source image at a first resolution, said first reso- 
lution being less than full resolution of said source 
image; 

requesting, from said client to said server, data from said 
hierarchical representation, additional to said portion of 
data transferred, necessary to reconstruct said source 
image at pixel coordinates for said source image; and 

transferring, from said server to said client, said additional 
data requested to display at said client said source 
image at said pixel coordinates, whereby only data of 
said hierarchical representation necessary to construct 
said source image at a pre-determined resolution at said 
client is transferred from said server to said client. 

9. The method as set forth in claim 8, wherein: 

the step of generating a hierarchical representation of a 
source image comprises the step of generating said 
wavelet decomposition for each level of said hierarchi- 
cal representation comprising low pass coefficients and 
a plurality of high pass coefficients; 

the step of transferring, from a server to a client, data from 
a level of said hierarchical representation comprises the 
step of transferring low pass coefficients corresponding 
to a level for said first resolution; and 

the step of requesting, from said client to said server, 
additional data, comprises the step of transferring addi- 
tional high pass coefficients necessary to construct said 50 
source image at said pixel coordinates. 

10. The method as set forth in claim 8, wherein the step 
of requesting, from said client to said server, additional data, 
comprises the step of transferring 0(N) coefficients to 
present "N" pixels for said pixel coordinates, wherein "N" 55 
comprises an integer value. 

11. The method as set forth in claim 8, wherein: 

the step of transferring, from a server to a client, at least 
a portion of data comprises the step of transferring a 
portion of said source image at a zoom resolution 60 
greater than a resolution capable of display at said 
client; and 

the step of requesting, from said client to said server, data 
from said hierarchical representation comprises the 
step of requesting pixel coordinates to pan said source 65 
image at a resolution at least as great as said zoom 
resolution. 



12. The method as set forth in claim 8, wherein: 

the step of transferring, firom a server to a client, at least 
a portion of data comprises the step of transferring said 
source image at said first resolution; and 

the step of requesting, from said client to said server, data 
from said hierarchical representation comprises the 
step of requesting pixel coordinates at a second 
resolution, greater than said first resolution. 

13. A system comprising: 

a server for storing transform data as a hierarchical 
representation, said transform data generated from 
source data using a wavelet transform with fixed point 
kernels, said hierarchical representation comprising a 
plurality of levels of essentially non-redundant data, 
wherein a level of said hierarchical representation 
comprises transform data sufficient to reconstruct said 
source data at a resolution corresponding to said level; 

at least one client, coupled to communicate with said 
server, said client requesting to said server transform 
data from a level of said hierarchical representation 
necessary to reconstruct at least a portion of said source 
data; 

said server for transferring to a client said transform data 

from said hierarchical representation upon request by 

said client; and 
said client for re-constructing, at said client, said portion 

of said source image for display at said client with said 

transform data. 

14. The system as set forth in claim 13, wherein: 

said client further comprises software for requesting, to 
said server, transform data from said hierarchical rep- 
resentation necessary to reconstruct a new portion of 
said source data; 

said server further comprises software for transferring, to 
said client, additional transform data from a level of 
said hierarchical representation, corresponding to said 
new portion of said source data, down one or more 
lower levels of said hierarchical representation to said 
level previously transferred; and 

said client further comprises software for reconstructing 
said new portion of said source data with said addi- 
tional transform data and said transform data originally 
transferred, whereby only incremental transform data 
necessary to construct said new portion of said source 
data at said client is transferred from said server to said 
client. 

15. A computer readable medium comprising a plurality 
of instructions, which when executed by a computer, cause 
the computer to perform the steps of: 

transforming source data into a hierarchical representa- 
tion using a wavelet transform with integer kernels, 
said hierarchical representation comprising a plurality 
of levels of essentially non-redundant data, wherein a 
level of said hierarchical representation comprises 
transform data sufficient to reconstruct said source data 
at a resolution corresponding to said level; 

requesting, from a client to a server, transform data from 
a level of said hierarchical representation necessary to 
reconstruct at least a portion of said source data; 

transferring, from said server to said client, said transform 
data from said hierarchical representation requested by 
said client; and 

re-constructing, at said client, said portion of said source 
image for display at said client with said transform 
data. 
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16. The computer readable medium as set forth in claim 
15, further comprising the steps of: 

requesting, from said client to said server, transform data 
from said hierarchical representation necessary to 
reconstruct a new portion of said source data; s 

transferring, from said server to said client, additional 
transform data from a level of said hierarchical 
representation, corresponding to said new portion of 
said source data, down one or more lower levels of said 
hierarchical representation to said level previously 
transferred; and 

reconstructing said new portion of said source data with 
said additional transform data and said transform data 
originally transferred, whereby only incremental trans- 
form data necessary to construct said new portion of 
said source data at said client is transferred from said 
server to said client. 

17. The computer readable medium as set forth in claim 
15, wherein: 

the step of transforming said source data into a hierarchi- 
cal representation comprises the step of utilizing said 
wavelet transform to generate a plurality of low pass 
coefiBcients and a plurality of high pass coefficients; 

the step of requesting data from said hierarchical repre- 25 
sentation comprises the step of transferring coefficient 
coordinates to identify coefiBcients sufficient to 
re -construct said portion of said source image; and 
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the step of re -constructing said portion of said source 
image comprises the step of transforming said coeffi- 
cients to generate said portion of said source image. 

18. The computer readable medium as set forth in claim 
17, wherein the step of utilizing said wavelet transform to 
generate a plurality of low pass coefficients and a plurality 
of high pass coefficients comprises the step of generating 
low pass coefficients for each level of said hierarchical 
representation, so as to aggregate sufficient information to 
render a viewable display of said source image at a resolu- 
tion corresponding to said level. 

19. The computer readable medium as set forth in claim 
17, wherein the step of requesting, from said client to said 
server, transform data comprises the step of transferring 
0(N) coefficients to represent "N" pixels for display at said 
client, wherein "N** comprises an integer value. 

20. The computer readable medium as set forth in claim 
15, wherein the step of transfonming said source data into a 
hierarchical representation comprises the step of executing a 
finite impulse response function to generate said transform 
data. 

21. The computer readable medium as set forth in claim 
15, wherein the step of transfonming said source data into a 
hierarchical representation comprises the step of preserving 
geometry between said source data and said transform data, 
so that any portion of said source data is identifiable from a 
portion of said transform data. 

♦ ♦ * ♦ ♦ 
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